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APPENDIX  A 

HIERARCHICAL  ROLLBACK  PROCEDURES 
FOR  DERIVING  NORMALIZED 
UTILITY  AND  IMPORTANCE  SCORES 


A-l 


This  appendix  describes  how  utility  values  or  importance  weights  are 
derived  for  items  organized  hierarchically.  Figure  A-l  illustrates  the 
process  for  a  hierarchy  of  hypothetical  tasks,  subtasks  and  skills.  In 
Figure  A-l,  the  ultimate  objective  is  to  compute  a  set  of  normalized  utility 
scores  for  the  skills.  Utility  scores  will  be  derived  based  on  ratings 
provided  by  SMEs.  In  CIEA,  ratings  are  obtained  using  a  rank  and  rate 
method  in  which  SMEs  first  rank  items  in  terms  of  utility  or  importance 
and  then  assign  ratings  that  reflect  the  distance  between  items.  Thus,  the 
procedure  calls  for  comparisons  between  items.  When  the  number  of  items  to 
be  rated  is  large  (greater  than  10)  it  is  difficult  for  SMEs  to  make  com¬ 
parisons  between  items.  A  hierarchy  is  used  to  organize  the  items  into 
small  groups  within  which  comparison  is  relatively  easy. 

When  a  hierarchy  is  employed,  the  derivation  of  utilities  requires  that 
items  in  each  level  of  the  hierarchy  be  ranked  and  rated.  The  ratings  at 
each  level  are  scaled  and  the  scaled  values  are  "rolled  back"  through  the 
hierarchy  to  yield  utility  scores  for  the  terminal  items  in  the  hierarchy 
(skills  in  Figure  A-l).  Referring  to  Figure  A-l,  the  normalized  scores  for 
the  skills  were  derived  by  first  rating  items  in  each  level  of  the  hierarchy 
using  a  0-100  scale.  Next,  the  rated  values  were  divided  by  100.  Then, 
values  were  multiplied  across  (or  down)  the  hierarchy  of  tasks,  subtasks, 
and  skills  until  there  was  a  single  value  for  each  skill.  When  all  the  skill 
values  were  determined,  the  set  of  all  skill  values  was  normalized  by  totaling 
the  set  of  values  and  dividing  each  value  by  the  total. 

An  alternative  to  the  above  process  would  be  to  normalize  items  at  a 
given  level  to  1.0  and  roll  the  normalized  values  through  the  hierarchy.  The 
same  normalized  utility  scores  of  the  skills  would  result,  but  the  summing 
of  uncorrected  utility  scores  and  dividing  each  uncorrected  score  by  the  sum 
to  yield  a  normalized  score  would  not  be  required.  Derivation  of  normalized 
scores  at  each  level  of  the  hierarchy  would  require  that  the  ratings  of  a 


-2 


set  of  items  be  summed  and  the  rating  of  each  item  be  divided  by  the  result¬ 
ing  sum.^  The  sum  of  the  normalized  scores  of  a  set  of  items  would  be  one. 
When  the  normalized  values  of  items  are  rolled  back  through  the  hierarchy, 
the  resulting  utility  scores  of  the  skills  will  sum  to  1.0  also.  Either 
procedure  is  equally  effective.  Choice  of  a  procedure  depends  on  user 
preference . 


Note:  When  items  are  not  organized  hierarchically  (e.g.,  there  is  less  than 
10  items)  this  same  procedure  is  used  to  derive  normalized  scores.  That  is, 
the  ratings  are  summed  and  the  rating  of  each  item  is  divided  bv  the  sum. 
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CEV  GUNNERY  TASKS 


Task  II  Title 

CLUSTER  0.  PERFORM  PREPARE  TO  FIRE  CHECKS 

SL  1 

C1001  Perform  Driver  prefire  checks 

C1002  Perform  Loader  prefire  checks 

C1002A  Perform  Loader  prefire  checks  for  main  gun 

SL  2 

C2001  Perform  Gunner  prefire  checks 

C2002  Boresight  the  7.62mm  coax  machine  gun  M-73 

C2003  Boresight  the  7.62mm  coax  machine  gun  M-240 

C2004  Align  the  infinity  sight  with  7.62mm  coax  machine  gun 

C2005  Zero  the  7.62mm  coax  machine  gun 

C2006  .Boresight  the  165mm  M-235  main  gun 

SL  3 

C3001  Perform  tank  commander  (TC)  prefire  checks 

C3001A  Perform  tank  command  (TC)  prefire  checks  for  main  gun 

C3002  Boresight  the  caliber  .50  M-85  machine  gun 

C3003  Zero  the  caliber  .50  M-85  machine  gun 

CLUSTER  1.  PERFORM  AMMUNITION  HANDLING 
SL  1 

C1101  Perform  Loader  misfire  procedures  for  main  gun 

C 1 1 02  Load/stow  165mm  main  gun  ammunition 

Cl  103  Load  the  M-135  main  gun 

Cl  104  Load/stow  basic  load  ammunition 

Cl  105  Load  the  7.62mm  coax  machine  gun  M-240 

Cl  106  Load  the  7-62mm  coax  machine  gun  M-73 

C1107  Apply  immediate  action  to  reduce  a  stoppage  in  the 

7.62mm  coax  machine  gun 
SL  2 

C2101  Perform  Gunner  misfire  procedures  for  main  gun 

SL  3 

C3101  Load  the  caliber  .50  M-85  machine  gun 

C3102  Correct  a  stoppage  of  the  caliber  .50  M-85  machine 

gun  using  immediate  action 


C2101 

C3101 

C3102 


CLUSTER  2.  OCCUPY  FIRING  POSITIONS 
SL  1 


24. 

Cl  201 

Move  into  firing  positions 

. 

SL  2 

r 

25. 

C2201 

Prepare  a  circular  range  card 

i 

SL  3 

r- 

26. 

C3201 

Prepare  range  cards 

27. 

C3202 

Select  firing  positions 

28. 

C3203 

Direct  movement  into  a  firing  position 

*1 

B-2 


CEV  GUNNERY  TASKS  (Cont'd) 


Item  Task  //  Title 

CLUSTER  3.  ENGAGE  TARGETS 
SL  1 


29. 

Cl  301 

Respond  to  a  firing  command  as  Loader  or  driver 

30. 

C1302 

Detect  and  identify  targets 

31. 

C1303 

Operate  CEV  during  7.62mm  coax  machine  gun  target 
engagement 

32. 

C1304 

Engage  targets  with  7.62mm  coax  machine  gun  as  loader 

SL  2 

33. 

C2301 

Respond  to  a  firing  command  as  Gunner 

34. 

C2302 

Engage  targets  during  limited  visibility  as  Gunner 

35. 

C2303 

Illuminate  targets  with  searchlight  as  Gunner 

36. 

C2304 

Determine  target  range 

37. 

C2305 

Engage  stationary  targets  with  main  gun  using 
burst-on-target  (BOT) 

38. 

C2306 

Engage  targets  with  main  gun  using  rapid  sequential 
round  as  Gunner 

39. 

C2307 

Engage  targets  with  7.62mm  coax  machine  gun  as  Gunner 

SL  3 

40. 

C3301 

Issue  a  firing  command 

41. 

C3302 

Engage  targets  during  limited  visibility  as  TC 

42. 

C3303 

Illuminate  targets  with  search  light  as  TC 

43. 

C3304 

Engage  targets  with  main  gun  using  rapid  sequential 
round  as  TC 

44. 

C3305 

Engage  ground  targets  with  caliber  .50  M-85  machine  gun 

45. 

C3306 

Engage  aerial  targets  with  caliber  .50  M-85  machine  gun 

46. 

C3307 

Engage  targets  with  7.62mm  coax  machine  gun  as  TC 

B-3 


12F  CEV  GUNNERY  SKILL  LIST 


Recall  location  and  function  of  switches,  controls,  and  indicators. 
Perform  engine  start  and  stop  procedures. 

Recall  proper  cleaning  procedures  for  optical  equipment. 

Recall  procedures  for  maintaining  proper  recoil  oil  fluid  level. 
Recall  armament  systems  damage  criteria. 

Operate  breechblock  operating  handle. 

Recall  ammunition  serviceability  criteria. 

Recall  that  radios  must  be  switched  to  OFF  during  engine  start. 
Recall  firing  circuit  test  procedures. 

Recall  ammunition  safety  cautions  and  warnings. 


Recall  main  gun  boresighting  procedures. 

Recall  stowage  location  of  fire  control  equipment. 
Recall  gun  control  check  procedures. 


Operate  fire  control  equipment. 

Install/dismount  and  stow  direct  fire  sighting  equipment. 
Recall  misfire  procedures. 


Recall  that  turret  lock  must  be  in  locked  position  before  removing/ 
stowing  ammunition  in  hull  storage. 

Recall  that  main  gun  should  not  be  elevated  above  178  miles  (10  degrees) 
during  loading. 

Recall  procedure  for  installing/removing  inner  and  outer  rounds 
in  165mm  ready  rack. 

Drive  CEV  in  daylight  or  dark. 


Use  military  symbols. 


1 2 F  CEV  GUNNERY  SKILL  LIST  (Cont'd) 


022  Recall  the  four  elements  required  to  plat  a  target  on  a  range  card- 
023  Identify  potential  targets. 

024  Determine  target  azimuth. 

025  Use  binoculars  and  WORM  formula  to  estimate  range. 

026  Recall  that  best  source  of  range  is  a  tank  mounted  range  finder. 

027  Determine  quadrant  elevation  from  Firing  Table  FT-165-A1. 

028  Recall  that  range  cards  must  be  prepared  for  primary,  alternate 

and  supplemental  firing  positions. 

029  Use  map  symbols. 

030  Recall  CEV  capabilities  and  limitations. 

031  Recall  site  selection  criteria  for  CEV. 

032  Recall  that  dangerous  targets  may  require  immediate  engagement 
without  regard  to  firing  positions. 

033  Use  arm  and  hand  signals  to  direct  vehicle  movement. 

034  Recall  elements  of  a  fire  command. 

035  Operate  CEV  intercom  system. 

036  Operate  main  gun  controls. 

037  Recall  best  method  of  destruction  for  target  types. 

038  Recall  techniques  for  target  detection. 

039  Recall  that  CEV's  mounting  searchlights  do  not  fire  while 
illuminating  because  of  smoke  and  dust  obscuration. 

040  Recall  that  CEV's  with  searchlight  mounted  should  not  fire  because 
of  possible  muzzle  blast  damage  to  searchlight. 

041  Recall  techniques  for  searchlight  employment. 

042  Recall  that  search  light  must  not  be  used  in  overdrive  more  than 
once  every  five  minutes. 

043  Use  appropriate  sighting  equipment  for  Clack  light. 

044  Recall  that  CEV  should  move  to  alternate  position  as  soon  as  possible. 

B-5 
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Operational  Sequence  Diagrams  for  Collective  CEV  Gunnery  Tasks 

In  order  to  facilitate  evaluation  of  DORACs  for  assessing  gunnery  pro¬ 
ficiency  of  CEV  personnel,  operational  sequence  diagrams  (OSDs)  have  been 
prepared  which  depict  the  flow  of  activities  performed  in  conduct  of  CEV 
gunnery  tasks  and  describe  the  actions  and  interactions  of  crew  members  as 
activities  are  performed.  Successful  employment  of  the  CEV  as  a  demolition 
weapon  depends  on  the  extent  to  which  the  crew  functions  as  a  coordinated 
team.  Thus,  in  order  to  be  maximally  useful,  DORACs  for  CEV  gunnery  should 
provide  for  the  assessment  of  CEV  crew  readiness.  By  comparing  the  OSD  de¬ 
scriptions  of  crew  requirements  in  gunnery  task  performance  against  the  scenario 
and  evaluation  capabilities  of  various  DORACs  proposed,  we  can  identify  the 
DORACs  that  have  the  greatest  ability  to  assess  CEV  crew  readiness. 

A  master  flowchart  has  been  prepared  which  portrays  the  sequence  of 
activities  required  in  conduct  of  firing  missions.  Blocks  1.0  through  5.2-2 
describe  activities  performed  to  prepare  the  CEV  for  a  firing  mission.  In¬ 
cluded  in  these  activities  are  stowing  the  basic  load  of  ammunition  for  the 
weapons  systems,  performing  all  checks  of  the  weapons  system,  boresighting 
the  weapons,  and  loading  and  zeroing  the  machineguns.  Activities  performed 
in  conduct  of  various  types  of  firing  missions  are  presented  in  blocks  7.0 
through  53.0.  Firing  missions  are  distinguished  in  terms  of  whether  the  CEV 
is  firing  from  a  predetermined  firing  position  using  a  range  card  (blocks 
11.0-13.0)  or  from  a  position  taken  while  moving  in  support  of  a  maneuver 
force  (blocks  7. 0-9.0)  and  on  the  basis  of  the  weapon  system  employed: 
machinegun  (block  15.0),  searchlight  (27.0),  or  maingun  (32.0). 

Combining  various  activity  blocks  on  the  master  flowchart,  seven 
collective  tasks  have  been  developed  that  encompass  crew  requirements  for 
the  gunnery  portion  of  CEV  employment.  The  seven  collective  gunnery  tasks  are: 

1.  Preparation  of  CEV  for  Firing  Mission. 

2.  Engagement  of  Targets  with  7.62mm  Coax  Machinegun. 

3.  Engagement  of  Aerial  Targets  with  Cal  .50  Machinegun. 

A.  Engagement  of  Ground  Targets  with  Cal  .50  Machinegun. 

5.  Engage  Targets  with  Searchlight  from  Predetermined  Positions. 

6.  Engagement  of  Targets  with  165mm  Gun  from  Predetermined  Firing 
Position 


7.  Engagement  of  Targets  with  165mm  Gun  as  Part  of  Maneuver  Force. 

Task  descriptions  consist  of  a  flowchart  of  activities  performed  during 
conduct  of  the  task  followed  by  verbal  descriptions  of  actions  performed  by 
the  different  CEV  crew  members  during  task  performance.  Activities  presented 
in  a  task  flowchart  are  numbered  in  reference  to  activities  in  the  master 
flowchart.  The  verbal  description  of  task  activities  consists  of  four  panels 
(one  for  each  crew  member)  divided  into  a  series  of  blocks.  A  description 
of  a  particular  action  performed  by  a  crew  member  in  performance  of  a  task  ac¬ 
tivity  is  provided  in  a  block.  In  the  lower  right  hand  corner  of  each  block 
with  text  is  an  alphanumeric  dode  which  keys  the  action  performed  in  the  block 
to  an  activity  in  the  task  and  master  flowcharts  (i.e.,  5.0,  10.0,  etc.), 
identifies  the  position  of  the  action  in  the  sequence  of  actions  that  accomplish 
the  activity  (i.e.,  1st  action,  2nd  action,  etc.),  and  identifies  the  crew 
member  that  performs  the  action  (a=tank  commander,  b=gunner,  c=loader, 
d=driver) .  For  example,  a  block  numbered  10.2c  refers  to  an  action  performed 
by  the  loader  which  is  the  second  action  in  the  sequence  of  actions  performed 
to  accomplish  activity  10.  Note  that  actions  described  in  a  block  can  be  a 
part  of  more  than  one  activity. 

In  the  lower  left  hand  corner  of  each  block  is  another  alphanumeric  code 
in  parentheses.  The  action  descriptions  p-ovided  in  the  different  blocks  were 
taken  from  the  individual  task  descriptions  prepared  earlier.  The  codes  in  paren 
theses  reference  an  action  to  a  specific  individual  task  (first  five  digits) 
and  element  of  that  task  (digits  following  the  decimal). 
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APPENDIX  D 


D-PAC  COSTING  GUIDE 


D-PAC  COSTING  GUIDELINE 


Introduction 


The  objective  of  the  following  costing  guideline  is  to  lead  an 
analyst  through  a  series  of  steps  that  will  lead  to  an  estimate  of  the 
cost  of  developing,  acquiring,  and  operating  a  DORAC.  Factors  that  are 
considered  in  estimating  the  total  cost  of  the  capability  include  the 
following : 

1.  Facilities — Physical  assets  (buildings,  land,  etc.) 
required  for  the  implementation  and  support  of  a 
DORAC  system. 

2.  Equipment — Hardware  directly  associated  with  evaluation 
positions  and  their  support. 

3.  Materials — Software  (user  materials,  films,  texts, 
computer  programs,  etc.)  necessary  for  the  conduct 
and  support  of  DORAC  evaluations. 

4.  Personnel — Evaluator  and  evaluatee  costs  incurred  as  a 
direct  result  of  DORAC  evaluation  activities  (e.g., 
salaries,  travel,  per  diem,  expendable  supplies,  etc.). 

The  first  step  in  costing  a  DORAC  is  to  specify  the  exact  nature  of 
each  alternative;  that  is,  to  list  the  devices  required,  the  planned 
number  of  evaluations  per  year,  and  support  requirements  in  terms  of 
operators,  evaluators,  and  maintenance  personnel;  and  so  forth.  Then, 
for  each  training  device  comprising  port  of  an  alternative  and  for  the 
baseline  alternative,  the  following  series  of  steps  is  completed: 

Step  1.  Compute  Anticipated  Facility  Load  (AFL) 

a.  Specify  Annual  Evaluation  Frequency  (AEF) ,  the  number  of  times 
each  evaluatee  must  be  evaluated  annually  using  the  device. 

b.  For  the  device,  specify  the  Evaluation  Cycle  Size  (ECS),  the 
number  of  evaluation  positions  that  can  be  used  simultaneously. 


Identify  Organization  Evaluation  Unit  Size  (OEUS) ,  the 
evaluatee  group  size  (e.g.,  individual,  squad,  platoon, 
company,  etc .)  .organ i c  to  the  base  organization  (e.g., 
battalion,  brigade,  division,  post,  etc.)  that  most  closely 
matches,  without  exceeding,  the  ECS. 


«  > 

V*»  V* 


Specify  the  number  of  Evalu.itees  per  Organization  (E/0),  the 
total  number  of  personnel  within  the  base  organization  that 
the  evaluation  is  applicable  to. 


Compute  Base  Facility  Load  (BFL) ,  the  number  of  evaluations 
required  to  put  all  relevant  base  organizations  (N  )  through 
one  evaluation  cycle:  °r^ 


RE  +  EFL. 


Compute  Device  Capability  (DC) 

Determine  Work  Segment  Length  (WSL) ,  the  length  of  time  in 
hours  between  work  starts  and  stops  during  the  work  day. 


Compute  Organizational  Evaluations  (OE) ,  the  number  of 
evaluation  cycles  required  to  process  one  base  organization: 


OE  = 


BFL  =  N  x  OE,  (A- 

org 

where  N  is  the  number  of  base  organizations 
or  £ 

scheduled  to  undergo  evaluation. 

Compute  Estimated  Facility  Load  (EFL),  the  expected  number 
of  evaluation  cycles  to  process  all  base  organizations  on 
all  evaluations: 

EFL  =  BFL  x  AEF.  (A- 

Determine  the  expected  number  of  re-evaluation  (RE)  cycles: 

RE  =  I’LF,  x  EFL,  (A- 

where  PLE  is  the  estimated  percentage  of  lost 
evaluations . 

Finally,  compute  AFL,  the  expected  number  of  evaluation  cycles 
required  to  process  all  evaluatees,  plus  expected  re- 
evaluations  : 


Specify  the  Number  of  Work  Segments  (NWS),  the  number  of  WSL 
periods  per  work  day. 


a 


c. 


Estimate  Evaluation  Cycle  Lcn;;tli  (ECL)  ,  L he  anticipated  time 
in  hours  required  to  conduct  one  evaluation  cycle  using  the 
device. 


d.  Estimate  Time  Between  Cycles  (TBC) ,  time  in  hours  spent  in 
orientation  briefing,  data  collection,  or  critique. 

e.  Compute  the  number  of  Evaluation  Cycles  per  Day  (EC/D) 
(rounded  to  nearest  integer): 


EC/D  = 


WSh  x  SN 
ECL  +  TBC  ‘ 


f.  Estimate  Time  Device  Available  (TDA) ,  the  number  of  training 
days  per  year  the  device  is  expected  to  be  operational  (round 
to  nearest  day) : 

TDA  =  PTA  x  TDY ,  (A 

where  PTA  is  the  percentage  of  time  the  device 

is  expected  to  be  available, 

and  TDY  is  the  number  of  training  days  per  year. 

g.  Compute  Device  Capability  (DC),  the  expected  number  of  evalua 
tion  cycles  per  year  that  one  device  will  accommodate: 

DC  =  TDA  x  (EC/D).  (A 


Step  3.  Compute  the  Number  of  Devices  Required  (NDR) : 


Step  A.  Determine  Incremental  Acquisition  Cost  of  Device  (ACD) 


Compute  Device  Hardware  Cost  (DHC) ,  the  cost  of  acquiring  the 
required  number  of  devices  (above  t ho  number  required  solely 
for  training) : 

DHC  =  (NDR  -  NDOII)  x  UCD,  (/ 

where  NDOH  is  t he  number  of  devices  on  hand  for 
training  purposes, 

and  UCD  is  the  unit  cost  of  the  device. 


Determine  Direct  Personnel  Costs  (DPC) .  DPC  is  the  sum  of  the 
estimated  number  by  proposed  pay  grade  of  operators,  evaluators, 
and  maintenance  personnel  multiplied  by  their  salaries  and 
benefits.  Again,  this  is  the  incremental  cost  associated  with 
providing  personnel  for  purely  evaluation  purposes. 

Determine  evaluation-related  Personnel  Training  Costs  (PTC) : 

PTC  =  CIT  +  EFT,  (A-ll) 

where  CIT  is  the  cost  of  initial  training  for 
operators,  evaluators,  and  maintainers ; 

and  EFT  is  the  expected  cost  of  follow-on 
training  (if  any)  plus  the  cost  of  training 
replacements  for  the  initial  cadre. 

Compute  Administrative  Operating  Costs  (AOC) : 

AOC  =  EXS  +  TC,  (A-12) 

where  EXS  is  the  cost  of  data  recording  supplies, 
office  supplies,  facilities  supplies,  equipment 
supplies,  utilities,  ammunition,  targets,  and  so 
fortli  associated  with  evaluation  activities, 

and  TC  is  the  cost  of  any  required  travel  for 
evaluatees  or  cadre  (again,  evaluation  related). 

Estimate  Facilities  Cost  (FC) .  FC  is.  the  total  cost  of 
required  acquisition,  construction,  or  modification  for 
device-related  facilities  used  solely  for  evaluation. 

Estimate  Annual  Maintenance  Cost  (AMC) ,  the  annual  cost  of 
maintaining  device-related  facilities  used  solely  for 
evaluation . 

Compute  ACD: 

ACD  =  DHC  +  (DPC  +  AOC  +  AMC)  x  EY  +  PTC  +  FC,  (A-13) 
where  EY  is  the  expected  life  of  the  device. 


Step  5.  Determine  Total  Device  Cost  (TDC) 


TDC  =  ACD  +  EEIR  x  DHC  x  EY, 

where  EEIR  is  the  expected  replacement  rate 
(percentage)  per  year  for  end  item  equipment 
used  for  evaluation  purposes. 


Step  6.  Determine  Total  Estimated  Cost  of  Alternative  (TECA) : 


After  the  estimated  cost  of  each  device  constituting  a  DORAC  alterna 
tive  is  calculated,  these  costs  are  summed  to  produce  the  Total  Estimated 
Cost  of  the  Alternative  (TECA) : 


TDC.  , 

i 


(A-15 


where  NDEV  is  the  number  of  individual  devices 
constituting  DORAC  alternative  i^, 

and  TDC.  is  the  estimated  cost  of  the  i device 
(from  A-^14)  . 

The  application  of  (A-15)  in  determining  the  total  estimated  cost  of 
alternative  i.  makes  the  assumption  that  all  individual  device  costs  are 
mutually  exclusive;  that  is.  no  shared  costs  (e.g. ,  common  operators, 
evaluators,  facilities,  etc.)  are  involved.  In  the  event  that  shared 
costs  are  involved,  assign  the  overlapping  costs  to  one  device.  In  this 
manner,  shared  costs  are  only  counted  one  time. 
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